Incremental Learning of Local Linear Mappings
نویسنده
چکیده
A new incremental network model for supervised learning is proposed. The model builds up a structure of units each of which has an associated local linear mapping (LLM). Error information obtained during training is used to determine where to insert new units whose LLMs are interpolated from their neighbors. Simulation results for several classiication tasks indicate fast convergence as well as good generalization. The ability of the model to also perform function approximation is demonstrated by an example.
منابع مشابه
Using Incremental Learning Algorithms in the Search for Minimal and E ective Fuzzy Models
The approximation of nonlinear mappings by means of a smooth cooperation (by Gaussian mixture) of several linear experts has become a very popular approach in the connectionist, fuzzy and statistical communities. Two simultaneous types of tuning are required: one concerns the number of the local models whereas the other concerns the ne adjustment of the Gaus-sian zones and of the local linear m...
متن کاملIncremental Learning of Convolutional Neural Networks
Convolutional neural networks provide robust feature extraction with ability to learn complex, highdimensional non-linear mappings from collection of examples. To accommodate new, previously unseen data, without the need of retraining the whole network architecture we introduce an algorithm for incremental learning. This algorithm was inspired by AdaBoost algorithm. It utilizes ensemble of modi...
متن کاملFast and Efficient Incremental Learning for High-Dimensional Movement Systems
We introduce a new algorithm, Locally Weighted Projection Regression (LWPR), for incremental real-time learning of nonlinear functions, as particularly useful for problems of autonomous real-time robot control that requires internal models of dynamics, kinematics, or other functions. At its core, LWPR uses locally linear models, spanned by a small number of univariate regressions in selected di...
متن کاملIncremental Online Learning in High Dimensions
Locally weighted projection regression (LWPR) is a new algorithm for incremental nonlinear function approximation in high-dimensional spaces with redundant and irrelevant input dimensions. At its core, it employs nonparametric regression with locally linear models. In order to stay computationally efficient and numerically robust, each local model performs the regression analysis with a small n...
متن کاملLWPR: A Scalable Method for Incremental Online Learning in High Dimensions
Locally weighted projection regression (LWPR) is a new algorithm for incremental nonlinear function approximation in high dimensional spaces with redundant and irrelevant input dimensions. At its core, it employs nonparametric regression with locally linear models. In order to stay computationally efficient and numerically robust, each local model performs the regression analysis with a small n...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1995